cameron said he knows that ` fear and worries ' remain over immigration .
under tories , two-thirds of uk job growth now benefits british citizens .
pm said he will continue ` serious , sustained attempt ' to control immigration .